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SPECIFICATION 

[Elertronic Version 1.2.8] 

[Method and Apparatus for the Suppression 
of Pinning in Stereoscopic Display Systems] 

Background of Invention 



[0001 ] References Cited 

[0002] Vision Research, Vol. 14, no. 10, p. 975-82 1974 

[0003] Vision Research, Vol. 28, no.4, p. 555-62, 1988 

[0004] Neural Networks, Vol. 6, no.4, p.463-83, 1993 

Summary of Invention 

[0005] The present invention relates to the augmentation of stereoscopic display 

systems to suppress undesired visual artifacts. 

[0006] Stereoscopic image display systems rely on the presentation of slightly 



different views of a scene to each eye of the viewer. Objects within these separate 
images are laterally displaced such that each eye sees the same object at somewhat 
different locations. The discrepancy between perceived location creates a condition 
known as retinal disparity. The human visual system infers depth by means of this 
discrepancy and if all such objects within the field of view exhibit consistent 
stereoscopic ekies cues , the observer perceives a sense of depth and thus a 
stereoscopic illusion. A variety of stereoscopic display systems have been described in 
the patent literature. 

[0007] The human visual system relies on a variety of visual e+ue* cijes as it 

determines depth from the visual images it sees. Depth can be perceived by means of 
relative motion, relative size, increased detail in objects closer to the viewer, etc. It is 
well known that some depth ekte* cues are more powerful than others. For example, 
persons with monocular vision can still perceived depth by means of relative motion and 
by means of observing some objects to obscure others in the field of view. Those 
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objects that obscure others are interpreted as being closer than those objects they 
obscure, for example. 

[0008] Human vision relies on a complex and little understood process commonly 

known as "scene interpretation" as it brings order to visual perception. Such processes 
include segmentation, color perception, edge detection, etc. If a viewer Is presented 
with conflicting visual €tees cjjej. the normal human response is to restart the process of 
"scene interpretation" to determine if a more plausible interpretation of the visual field 
can be made. 

[0009] Consistency of visual clues cues is extremely important in the creation of 

stereoscopic imaging. If conflicts occur the sensation of depth is lost and the viewer 
perceives double vision. The stereoscopically encoded objects are no longer fused 
so as to be_ interoreted to be located appear at various points In space, but are seen as 
two distinct views that is confusing and uncomfortable for the viewer. 

[0010] The spatial position of a stereoscopic object Js_determined by the lateral, 

displacement of that object as seen bv each eye, if the right eve and the left eve views 
are superimposed, the perceived location of the object Is determined by the relative 
shift in position. If. for example, there is no shift and if the two views of the object 
appear at the same location. the_obiect will be perceived as app earing at the surface of 
the display screen. Such objects are said to have "zero parallax". If an object as s een by 
the right eve is displaced to the left of the position of the same object as seen b v the left 
eye, the object appears to b e fl oa t ing in front of the display surface an d is said to have , 
"negative parallax". Conversely, if an object seen with the right eve is displaced to the 
right of the position of the same object asseen bvthe left eye, the object appears to be 
positioned behind the display surface and is said to hav.eJ!positive parallax". T he 
movement of stereoscopic objects off of the ojra stereoscopic display so that thev are 
clipped by the edge of the display causes a common problem encountered in 
Stereoscopic images. The clipped object ts interpreted as be ing partially occluded bv 
the edge on border of the display. Objects with negative parallax, perceived to be 
floating in front of the display will create an occlusion conflict when thev begin to 
disappear "behind* the margin of the displa yed stereoscopic Image , dev i ce ■ These 
objects are ^occluded! by af* visual percept (the margin of the display surface) that has 
previously been interpreted as behind the stereoscopic object. Occlusion is a more 
powerful stereoscopic visual cues c4w than is retinal disparity. When these objects 
move off screen begin to intersect the, border of the stereo scopic display a conflict in 
visual cues €k*es is perceived causing a loss of the illusion of stereoscopic depth. This 
«:ond ? t 1r>ri lr eemmefriy Fefefged te grrronimpir "pinning", Jh fl r eQ '°" m which t he 
illusion of depth is lost is localized to those border regions in which a conflicts between 
occlusion and negative para lla x occur. Wherever this conflict occurs we shall within the 
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context of this patent refer to the image as being "pinned". The conflict will be te rmed 
"stereoscopic pinning" and the terms "pinned", "p inning* and "anti-ninnmcT will be used. 

• 

[0011] ff^ThP rendition that has been described in these teachings as 

stereoscopic pinning can be controlled when creating stereoscopic movies conieni by 
insuring that objects perceived as in front of the surface of the display (which is known 
as the zero parallax plane) are never moved off screen until they have receded to a 
position that is interpreted as behind the edge of the screen. When tfre steregseppje 
content is a movie, for example. Sitiee since the movie is carefully shot, pinning can be 
avoided by careful attention to the placement and movement of actors and objects 
within the scene. 

[001 2] Accordingly, several objects and advantages of this invention over existing 

methods and the teaching of the prior art include the object to provide means for 
suppressing the set of conditions that have been defined in these teachings to causa 
stereoscopic pinning "p i nning" during the presentation of stereoscopic images, videos, 
motion pictures and computer generated and or presented stereoscopic material. 

Brief Description of Drawings 

[001 3] Figure 1 depicts the spectral sensitivities of the three color sensing cones in 

the retinal mosaic. These are commonly termed Short, Medium and Long Wavelength 
Sensor and are abbreviated as SWS, MWS and LWS. Label 102 depicts the Long 
wavelength cone sensitivity curve. Label 1 04 designates the Medium wavelength cone 
sensitivity curve. Label 1 06 designates the Short wavelength cone sensitivity curve. 
Each cone sensor type can received a broad spectrum of light. Color is derived by 
comparing the signaling strength from neighboring cones. The Medium and Long 
Wavelength cone sensitivities overlap broadly whereas the Short Wavelength Sensor type 
cone has a narrow spectral range that does not broadly overlap the sensitivities of the 
MWS and LWS cones. As depicted in Figure 1 r light whose frequency is at or near 450 
nanometers is primarily sensed by the SWS cones. 

[0014] Figure 2 depicts the relative distribution of short, medium and long 

wavelength sensing cones. The figure consists of two micrographs of the same region 
of the retinal mosaic. The, labeled 202 includes the macular pigment. The second, 
labeled 204 depicts the same region without the macular pigment. The cones are more 
clearly seen in the region labeled 204. The Long wavelength cones are depicted by label 
206. Label 208 depicts the Medium wavelength cones whereas label 210 designates the 
Short wavelength cones. There are approximately sixteen times more medium and long 
wavelength cones than short wavelength cones as is indicated in this micrograph. 
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[001 5] Figure 3 depicts the central region of the fovea: the region of highest visual 

acuity. The area designed as 302 depicts the fovea region whereas label 304 indicates 
the central fovea. In this region of the retina the cone cells are smaller and more tightly 
packed than in the periphery of the retina. Moreover there are no short wavelength 
sensors in the central fovea. 

[001 6] Figure 4 shows a stylized representation of the apparatus described in this 

patent. Element 402 is the stereoscopic display device including border element 404 
and display element 406. The viewer's right and left eyes are depicted as elements 408 
and 41 0 P respectively. The anti-pinning border is defined by the region bounded by 
elements 41 2 and 41 4. 

Detailed Description 

[001 7] Although the following detailed description contains many specifics for the 

purposes of illustration, anyone of ordinary skill in the art will appreciate that many 
variations and alterations to the following details are within the scope of the invention. 
Accordingly, the following preferred embodiment of the invention is set forth without 
any loss of generality to, and without imposing limitations upon, the claimed invention. 

[001 8] The present invention accordingly has an objective to provide a variety of 

novel means for the creation of apparatus for presentation of stereoscopic material. 

[001 9] A preferred embodiment of this invention employs a perimeter around the 

displayed stereoscopic image that serves to provide ambiguous depth eluesr cues . Such 
ambiguity reduces or eliminates a well known stereoscopic artifact that has limited the 
use of stereoscopic imaging. This artifact is known in the art as "pinning" will be Cfllted 
"stereoscopic pinning" in the context of these teachings. Stereoscop ic pinning 4* occurs 
only whenever a stereoscopic object is presentec Lt o the viewer so that; it; w jj.lks 
perceived to be positioned as if floating in front of the display surface. If that object is 
translated so that it either touches or begins to move off the edge of the display, the 
visual system observes two conflicting visual c l ues cues : an object interpreted as being 
in front of the display is occluded by the edge of the display {which is perceived as 
behind the object). Since occlusion is a more powerful visual depth elue cjje. than is 
retinal disparity, the illusion of depth is destroyed broken and the viewer no longer 
perceives a stereoscopic image. 

[0020] The problem of stereoscopic pinning can occurs in all real time stereoscopic 

imaging systems. Those skilled in the art of creating stereoscopic content knowingly 
create stereoscopic content such that forward objects , those with negative parallax 
never intersect the edge of the displa y. Bv doing so as-*e they prevent Stergpscopic 
pinning from occurring. 



PAGE 6/16 • RCVD AT 4/3/2006 5:56:28 PM [Eastern Daylight Time] 1 SVR:USPT0-EFXRF-1/16 1 DNIS:2738300 * CSID: * DURATION (mm-ss) :04-58 



03/04 '06 MON 23:44 FAX 



ETHZCOMP. SYS 



(21007 



[0021) The apparatus described in this invention and shown in Figure 4 employs a 

luminous blue border along the periphery of the displayed image. The use of blue light 
is Intentional because of a variety of factors related to the human visual system. 

[0022] It is well known to those skilled In human vision that the lens of the human 

eye is a simple lens that is achromatic. That is, the lens focuses light of different 
wavelengths (colors) at various position in space. Light of deep blue color is always 
focused at a point that is substantially in front of the retina and is thus always perceived 
as out of focus. Moreover, blue light is primarily sensed by one of three color photo- 
receptor cells of the retina which are called SWS (Short Wavelength Sensor) orS cones. 
The region of the human retina which has the highest spatial acuity is located in a 
region known as the fovea region of the retina. It is well known that SWS cones are not 
present in the central region of the fovea. SWS cones begin to occur in the peripheral 
region of the fovea and are significantly less numerous, as is shown in Figure 2, than 
the other two types of color receptive cells (the MWS or M and LWS orL cones)- Various 
studies report that there are as few as one sixteenth as many SWS cones in the retina as 
other color sensors. The perception of blue light and in particular the use of a luminous 
blue border around the stereoscopic image provides ambiguous visual depth e^ue* cues 
that inhibit and reduce the problem of stereoscopic pinning, ideally, the luminous blue 
border should generate light that is only perceived by the SWS cone sensors (a 
wavelength of approximately 450 nanometers or shorter). 

[0023] The illusion of depth created by stereoscopic imaging is dependent on 

presenting slightly different images to each eye. Elements within each image are 
displaced laterally in a manner that is proportional to their perceived distance to the 
viewer. It is clear that the border of the stereoscopic displayed image can become a 
factor that can inhibit the perception of depth even though consistent stereoscopic cues 
(retinal disparity) are provided throughout the displayed image. 

[0024] Moreover, the luminous deep blue border along the edge of the display 

surface can be constructed so that the edge of the displayed image merges into the 
bordering region such that the intensity of the edge of the displayed image is subtly 
merged to deep blue, thus decreasing the discontinuity between the border of the 
displayed stereoscopic image and the image itself. 

[0025] The apparatus now disclosed and described can be further augmented to 

enhance the stereoscopic viewing experience by employing a luminous blue perimeter 
bounding the edge of the stereoscopic display area as shown in Figure 4. 

[0026] It is well known within the art that the human visual system employs a variety 

of visual data in order to perceive a sense of depth. These include relative size, relative 
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motion, retinal disparity and object occlusion. Object occlusion is a more powerful 
visual «h±e cue than is retinal disparity. 

[0027] It also well known that stereoscopic objects made to appear as if in front of 

the display surface can cause a conflict in visual clues cues if said object(s) move to or 
off the field of view. The object a ppears is seen to have disappeared behind the edge of 
the display and thus be occluded by an object that was initially perceived as behind said 
object. When this occurs the perception of depth Is lost. The two displayed images are 
no mr»rrjnH m nr. m pnrrRiwn rfppth hut fuspd in the mind to create the 

stereoscopic illusion of depth and the displayed Images are not fused and now appear 
as two slightly displayed displaced images. The illusion of depth is lost. "Stereoscopic- 
Plnning" is a term Refined within these teachings that is used to refer to the creation of 
this condition in stereoscopic display systems. 

[0028] It has been discovered that " stereoscopic- pinning" can be suppressed and/or 

eliminated by means of providing a luminous deep blue border around the periphery of 
the stereoscopic display area. 

[0029] Some aspects of human vision, although studied, are not well understood. 

But a rational argument can be made as to why this effect occurs. For example, the lens 
of the eye is a simple lens subject to chromatic distortion. Different wavelengths 
(colors) of light come to focus at different distances from the lens and the retina. Some 
colors (e.g. red) come to focus at a position that Is somewhat behind the surface of the 
retina. Conversely, other colors, such as blue (short wavelength light) come to focus 
substantially in front of the retina. The human visual system is not capable of focusing 
blue light onto the retina of the eye. 

[0030] The perception of color in the human visual system is not well understood. A 

number of retinal light sensing cells (cones and rods) have been identified. The 
frequency response and spatial distribution of these cells has been studied in great 
detail. There are three types of cone or color sensing cells within the eye which are 
typically called Long Wavelength, Medium Wavelength and Short Wavelength Sensors (L, 
M and S cones). As shown In figure 1 , the frequency response of the L and M cones Is 
broad whereas the S cones have a narrow frequency response. And although there is 
considerable overlap in the sensitivities of the L and M cones there is relatively little 
such overlap in the frequency response of the S cones. 

[0031] It is well known that there are no S cones in the most sensitive region of the 

retina which is called the fovea. Whereas most regions of the retina consist of a mixture 
of rod and cone sensing cells, the fovea only contains cone type cells and only those 
which are of the L and M types. S type cones are only detected in the periphery of the 
fovea region and their spatial distribution is much lower than either the L or M cones. It 
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